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TITLE OF THE INVENTION 
IMAGE PROCESSING APPARATUS AND METHOD 



FIELD OF THE INVENTION 
5 The present invention relates to an image 

processing apparatus and method and, more particularly, 
to an image processing apparatus and method for 
rendering an image on the basis of a rendering command. 



10 BACKGROUND OF THE INVENTION 

Upon outputting a high-quality image based on 
image data via a printer or display, a plurality of 
objects that form the image must undergo color 
processes such as color correction, color conversion, 

15 binarization, and the like in correspondence with the 
types of objects. 

In general, upon printing or displaying on a 
display device an image created by application software, 
rendering commands from the application software are 

20 imaged by a device driver (or device itself) of a 

printer or display device to create image data to be 
printed or displayed for the entire page. Rendering 
commands that form a document include, e.g., an image 
rendering command corresponding to a photo image 

25 portion, a text rendering command corresponding to a 
text portion, and a graphic rendering command 
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corresponding to a graphic portion. Such rendering 
commands are issued to the device driver, which execute 
color processes suitable for individual objects in 
units of types of commands, thus converting the 
5 commands into an image that an output device can output. 
Upon conversion, color matching processes are 
switched so that graphics, text, and photo portions 
respectively undergo "saturation", "colorimetric" , and 
"perceptual" processes, and an image in which all 

10 objects on the entire page have high image quality can 
be obtained. 

In recent years, some system or application 
software designates a "source color space" of each 
object, and the device driver can obtain a high-quality 

15 output image using the designated contents. For 

example, when a scanner input image is pasted onto a 
document, the image rendering command of that image can 
designate a color profile which describes the device 
characteristics of a scanner, or a color profile that 

20 describes the characteristics of a monitor used to 
reproduce colors observed by the editor upon color 
calibration on the display. Such color profiles are, 
for example. International Color Consortium (ICC) 
profiles, and Image Color Matching (ICM) of Windows®95 

25 available from Microsoft Corp., ColorSync of Apple 



- 2 - 



Computer, and the like are known as systems that can 
use such profiles. 

In order to implement the aforementioned image 
processes, upon printing even an image that the user 
5 recognizes as a single image, application software or 
an operating system often issues a plurality of 
rendering commands. In this case, whether or not 
rendering commands corresponding to a plurality of 
segmented images can be combined is checked by 

10 comparing apex coordinate information of rectangular 
regions as rendering regions of the respective 
rendering commands corresponding to the plurality of 
segmented images, as described in Japanese Patent 
Laid-open No. 2000-13622. 

15 For example, as shown in Fig. 1, when one image 

is issued as two image rendering commands, since the 
lower left apex of rectangular region 1-A of the first 
rendering command neighbors the upper left apex of 
rendering region 1-B of the second rendering command, 

20 and the lower right apex of rectangular region I-A also 
neighbors the upper right apex of rectangular region 
1-B, it is determined that images to be rendered by the 
two rendering commands can be combined. 

Recent application software normally has a 

25 function of cutting image data into an arbitrary shape. 
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When an image cut using this function is to be printed, 
a plurality of image rendering commands are issued. 

For example, as shown in Fig. 2, these image 
rendering commands are issued to be segmented into 
5 rectangular regions 2-A, 2-B, 2-C, 2-D, and 2-E. When 
the image is segmented, as shown in Fig. 2, the 
aforementioned method of checking by comparing apex 
coordinate information of these rectangular regions if 
rendering commands corresponding to a plurality of 

10 segmented images can be combined cannot determine 

whether all five image rendering commands corresponding 
to these cut (segmented) images can be combined. For 
this reason, these segmented images cannot undergo an 
identical correction process on the basis of the 

15 characteristics (e.g., color distribution) of an image 
that the user recognizes as a single image, and an 
image with poor image quality is obtained in place of 
that with high image quality. 

2 0 SUMMARY OF THE INVENTION 

The present invention has been made to solve the 
above problems, and has as its object to search for a 
plurality of objects obtained by segmenting a single 
image . 

25 In order to achieve the above object, a preferred 

embodiment of the present invention discloses (claim 1) 



It is another object of the present invention to 
determine correction characteristics of the single 
image on the basis of the characteristics of the 
segmented objects when the segmented objects are found. 
5 In order to achieve the above object, a preferred 

embodiment of the present invention discloses (claim 
1 + 2) 

Other features and advantages of the present 
invention will be apparent from the following 
10 description taken in conjunction with the accompanying 
drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 



15 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a view for explaining an example of an 
image segmented into two image rendering commands ; 

Fig. 2 is a view for explaining an example of an 
image segmented into a plurality of image rendering 
20 commands; 

Fig. 3 is a block diagram showing the arrangement 
of an image processing apparatus according to an 
embodiment of the present inventions- 
Fig. 4 is a flow chart showing the process 
25 executed by a printer driver shown in Fig. 3; 



Fig. 5 shows the default state of an 
identification table; 

Fig. 6 shows an example of the state of an 
identification memory; 
5 Fig. 7 shows an example of the state of the 

identification table; 

Fig. 8 shows an example of the state of the 
identification memory; 

Fig. 9 shows an example of the state of the 
10 identification table; 

Fig. 10 shows an example of the state of the 
identification memory; and 

Fig. 11 is a flow chart showing the process 
executed by the printer driver shown in Fig. 3. 

15 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
An image processing apparatus according to a 
preferred embodiment of the present invention will be 
described in detail hereinafter with reference to the 
20 accompanying drawings. 

Fig. 3 is a block diagram showing the arrangement 
of an image processing apparatus of this embodiment. 

A printer 105 such as an ink- jet printer or the 
like, and a monitor 106 are connected to a host 
2 5 computer 100. 



The host computer 100 has application software 
101 such as a wordprocessor , spreadsheet, internet 
browser, and the like. Various rendering commands 
(image rendering command, text rendering command, and 
5 graphics rendering command) which are issued by the 

application software 101 and represent an output image 
are input to a monitor driver 104 via an operating 
system (OS) 102. Upon executing a print process, these 
rendering commands are also input to a printer driver 
10 103 via the OS 102. Each of the printer driver 103 and 
monitor driver 104 is software which processes these 
rendering commands to generate print data to be printed 
by the printer 105 or to display an image on the 
monitor 106. 

15 The host computer 100 comprises hardware 

components such as a CPU 108, hard disk (HD) 107, RAM 
109, ROM 110, and the like so as to store the 
aforementioned software and make it function. Note 
that a prevalently used IBM AT compatible personal 

20 computer may be used as the host computer 100 shown in 
Fig. 3, and Windows®95 of Microsoft Corp. may be used 
as the OS 102. A system in which arbitrary application 
software having a print function is installed in such 
personal computer and the monitor 106 and printer 105 

25 are connected to the personal computer is plausible. 



The host computer 100 generates output image data 
using text data categorized into text such as 
characters and the like, graphics data categorized into 
graphics such as figures, and the like, image data 
5 categorized into photo images and the like, and so 
forth, on the basis of an image displayed on the 
monitor 106. Upon printing an image based on the 
output image data, the application software 101 sends a 
print output request to the OS 102, and issues 

10 rendering commands including a text rendering command 
which defines the text data, a graphics rendering 
command which defines graphics data, and an image 
rendering command which defines image data. 

Upon receiving the print output request from the 

15 application software 101, the OS 102 passes the 
rendering commands to the printer driver 103 
corresponding to the printer 105. The printer driver 
103 processes the print output request and rendering 
commands passed from the OS 102 so as to generate print 

20 data that the printer 105 can print, and sends the 

print data to the printer 105. When the printer 105 is 
a raster printer, the printer driver 103 rasterizes the 
rendering commands on R, G, and B page memories each 
having a 24-bit depth. After all the rendering 

25 commands are rasterized, the printer driver 103 

converts the contents of the page memories into a data 



format that the printer 105 can print, e.g., C, M, Y, 
and K data, and sends these data to the printer 105. 
Note that the page memories are assured on the RAM 109. 

The flow of the process by the printer driver 103 
5 of this embodiment will be explained below with 
reference to Figs. 4 to 11. 

The printer driver 103 requests of the 
application software 101 or OS 102 print data 
(rendering commands) that form an image of a page to be 

10 printed twice. In response to the first and second 

requests, the application software 101 issues a set of 
all rendering commands required for outputting the page. 
Fig. 4 shows the flow for processing print data issued 
in response to the first request, and Fig. 11 shows the 

15 flow for processing print data issued in response to 
the second request. In the processing flow of print 
data show in Fig. 4, print data is interpreted to 
acquire information required for an image correction 
process, thus preparing for execution of the image 

20 correction process. In the processing flow of print 
data shown in Fig. 11, only a portion of the image 
rendering command that requires the image correction 
process undergoes the image correction process using 
the prepared the image correction process, a color 

25 matching correction process, and the rendering commands 
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are rasterized on the page memories to generate print 
data, which is transferred to the printer 105. 

The process of print data issued in response to 
the first request shown in Fig. 4 will be explained. 
5 An identification table used to discriminate 

segmented images is initialized in step SIO, and an 
identification memory for storing the rendering 
positions of images to discriminate segmented images is 
initialized in step S20. One rendering command is 

10 received in step S30, and is interpreted in step S40 to 
discriminate the type of object indicated by that 
rendering command. 

If the rendering command of interest is not an 
image rendering command, i.e., it is a text rendering 

15 command, graphics rendering command, or the like, it is 
determined in step S50 that the object is not a photo 
image, and the flow jumps to step S130. On the other 
hand, if the rendering command is an image rendering 
command, it is determined that the object is a photo 

20 image, and the flow advances to step S70. 

Since the image correction process to which this 
embodiment is applied corrects white balance or color 
balance disturbed under the influence of an image 
sensing condition or the like, the object to be 

25 corrected is a photo image. In general, most photo 

images are 24-bit RGB objects. An image having a bit 
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depth smaller than 24 bits, e.g., an 8-bit pallet is 
not appropriate as the object to be corrected. For 
this reason, the header of the image rendering command 
is referred to in step S70, and only when the bit depth 
5 is 24 bits or more, the flow advances to step S80; 

otherwise, it is determined that the rendering command 
of interest is not an object which can be corrected and 
the flow jumps to step S130. 

In case of at least 24-bit image object, the 

10 contents (e.g., pixel values) of the object passed in 
the form of the image rendering command are sampled in 
step S80, and it is checked in step S90 by the 
following method if a neighboring (or overlapping) 
image obtained by breaking up an identical image is 

15 present. 

When Image A is rendered on a rectangular region 
having coordinates (1, 2) and (3, 3) as diagonal apexes 
in accordance with the first image rendering command of 
a given page, as shown in Fig. 6, information 

20 indicating that Image A is rendered on that rectangular 
region and neighboring region is written in the 
identification memory. As the value of the information 
to be written, the identification table shown in Fig. 5 
is looked up, and a minimum value of identification 

25 numbers with use flags = FALSE is written. In case of 
Fig. 5, "1" is written. After the identification 



number is written in the identification memory, the 
identification table is updated, as shown in Fig. 7. 

When Image B is rendered on a rectangular region 
having coordinates (5, 2) and (7, 3) as diagonal apexes 
5 in accordance with the second image rendering command, 
since no identification number corresponding to another 
image rendering command is written in that region, it 
is determined that no neighboring image obtained by 
breaking up an identical image is present for Image B. 

10 Furthermore, when Image C is rendered on a 

rectangular region having coordinates (0, 3) and (8, 4) 
as diagonal apexes in accordance with the third image 
rendering command, the identification numbers 
corresponding to the image rendering commands of Images 

15 A and B have already been rewritten in that region. 
Hence, since these numbers indicate the presence of 
images which neighbor or overlap Image C, it is 
determined that neighboring Images A and B obtained by 
breaking an identical image are present for Image C. 

20 If it is determined in step S90 that a 

neighboring (or overlapping) image obtained by breaking 
up an identical image is present, the sampling results 
of these images in step S80 are combined in step SIOO. 
In step SllO, the identification numbers are 

25 written in the identification table as addresses 

indicating the correction information regions that save 
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the sampling results, as shown in Figs. 7 and 9. In 
case of Fig. 9, since it is determined that all Images 
A, B, and C can be combined, the correction information 
region addresses for Images A and B are updated so that 
5 all the three images indicate identical correction 

information regions, when the image rendering command 
corresponding to Image C is processed. In step S120, 
the identification number is written in the 
identification memory, as shown in Figs. 6, 8, and 10. 

10 The processes in steps S30 to S130 repeat 

themselves until it is determined in step S130 that the 
processes in steps S30 to S120 are complete for all 
rendering commands in the page. Upon completion of the 
processes for all print data (rendering commands) , the 

15 flow advances to step S140. In step S140, a correction 
parameter used in the image correction process, e.g., a 
gamma correction parameter or the like based on the 
color distribution or luminance information is computed 
on the basis of the correction information region 

20 addresses saved in the identification table, and the 

computed correction parameter is temporarily stored in, 
e.g., the RAM 109 in correspondence with the correction 
information region addresses. 

In this manner, the process of print data issued 

25 in response to the first request is completed, and the 
printer driver 103 issues the second request. 



Subsequently, the process of print data issued in 
response to the second request shown in Fig. 11 will be 
explained below. 

One rendering command is received in step S200, 
5 and is interpreted in step S210 to discriminate the 

type of object indicated by the rendering command. If 
the rendering command of interest is not an image 
rendering command, i.e., it is a text rendering command, 
graphics rendering command, or the like, it is 

10 determined in step S220 that the object is not a photo 
image, and the flow jumps to step S260. On the other 
hand, if the rendering command is an image rendering 
command, it is determined that the object is a photo 
image, and the flow advances to step S240. 

15 It is checked based on information temporarily 

stored in steps SllO and S120 in step S240 if the 
correction process for the received image rendering 
command is required. If it is determined that no 
correction process is required, the flow jumps to step 

20 S260. If it is determined that the correction process 
is required, the object which is requested to be 
rendered by the image rendering command undergoes the 
image correction process using the correction parameter 
temporarily stored in step S140 (step S250) . Whether 

25 or not the correction process is required can be 

determined by checking if the identification number is 



written in an area of the identification memory 
corresponding to the rendering region, and the 
correction parameter to be used can be easily 
determined based on the corresponding correction 
5 information region address. 

In step S260, a color matching module 111 shown 
in Fig. 3 executes a color process such as a color 
matching process in correspondence with the type of 
object. In step S270, an object is rasterized on the 

10 page memories on the basis of the rendering command. 
Note that the object of the photo image that has 
undergone the image correction process in step S250 
undergoes a "tincture priority" color matching process 
suitable for the photo image. 

15 The processes in steps S200 to S270 repeat 

themselves until it is determined in step S280 that the 
processes in steps S200 to S270 are complete for all 
rendering commands in the page. Upon completion of the 
processes for all print data (rendering commands) , the 

20 flow advances to step S290. In step S290, the print 

image data rasterized on the page memories undergoes a 
color process for the printer, a process for converting 
R, G, and B data into C, M, Y, and K data, a gamut 
process corresponding to the color reproducibility of 

25 the printer 105, and the like, thus converting the data 
into image data that can be output to the printer 105. 



In step S300, the image data processed to be suitable 
for the printer is sent to the printer 105. In a 
normal raster printer, image data is compressed in 
units of lines, and the compressed line data are packed 

5 into a simple command, which is to be transferred to 
the printer. 

In the above embodiment, a scheme (unbanding 
scheme) for assuring the identification memory for one 
page, which records the rendering positions of images 

10 so as to determine images obtained by breaking up an 

identical image, has been explained. Alternatively, a 
scheme (banding scheme) for assuring an identification 
memory corresponding to a segmented region may be used 
without assuring the identification memory for one page, 

15 by breaking up one page into a plurality of regions. 

In the above example, the print data request is 
issued twice. Alternatively, rendering commands 
obtained by the first request may be stored, and the 
process shown in Fig. 11 may be executed using the 

20 stored rendering commands. 

In the above embodiment, a printer driver which 
processes raster data has been exemplified as the 
printer driver 103. Also, the embodiment of the 
present invention can be applied to a printer driver 

25 corresponding to a page description language such as 
PostScript® of Adobe Systems Incorporated. 
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Furthermore, the user may manually set using the 
user interface of the printer driver 103 whether to 
execute the .image correction process or not. 

As described above, according to this embodiment, 
whether or not image rendering commands can be combined 
can be determined even for images which are 
complicatedly broken up by application software to 
render a cut image, as long as these images are located 
at neighboring positions. In this manner, when an 
object of a given type included in an input image is to 
undergo an image correction process in correspondence 
with the color distribution or the like, an identical 
image correction process can be done irrespective of 
the segmented shapes of images, thus obtaining a 
high-quality image output. 

As many apparently widely different embodiments 
of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
appended claims. 



WHAT IS CLAIMED IS: 

1. An image processing apparatus comprising: 

an input unit, arranged to input a rendering 
command; 

a discriminator, arranged to discriminate a type 
of object to be rendered on the basis of the rendering 
command; 

a judgment unit, arranged to judge based on the 
discrimination result if the object is to undergo a 
correction process; and 

a search unit, arranged to search for segmented 
objects obtained by breaking up a single image together 
with the object which is determined to undergo the 
correction process. 

2. The apparatus according to claim 1, further 
comprising a decision unit, arranged to decide a 
correction characteristic of the correction process on 
the basis of characteristics of segmented objects when 
the segmented objects are found. 

3. The apparatus according to claim 2, further 
comprising a correction unit, arranged to execute an 
identical correction process for a plurality of 
segmented objects that form the single image on the 
basis of the correction characteristic. 

4. The apparatus according to claim 1, wherein said 
search unit searches for the segmented objects on the 



basis of a rendering position of the object indicated 
by the rendering command. 

5. The apparatus according to claim 1, wherein said 
search unit has a memory for recording identification 

5 information indicating the presence of candidates of 
the segmented objects in correspondence with a 
rendering region of the object and neighboring regions 
thereof . 

6. The apparatus according to claim 5, wherein said 
10 search unit determines that the segmented object is 

present when the identification information which 
neighbors or overlaps the rendering region of the 
object indicated by the rendering command to be 
processed is present. 

15 7. The apparatus according to claim 5, wherein said 
search unit selects whether to record the 
identification information or not on the basis of a 
height or width of the segmented object and the number 
of objects within a page. 

20 8. The apparatus according to claim 2, wherein said 
decision unit comprises an extractor, arranged to 
extract a color or luminance distribution of the object 
which is determined to undergo the correction process. 
9. The apparatus according to claim 8, wherein said 

25 decision unit decides the correction characteristic by 
combining pieces of the color or luminance distribution 



information extracted from a plurality of segmented 
objects that form the single image. 

10. An image processing method comprising the steps 
of: 

inputting a rendering command; 

discriminating a type of object to be rendered on 
the basis of the rendering command; 

judging based on the discrimination result if the 
object is to undergo a correction process; and 

searching for segmented objects obtained by 
breaking up a single image together with the object 
which is determined to undergo the correction process. 

11. The method according to claim 10, further 
comprising the step of deciding a correction 
characteristic of the correction process on the basis 
of characteristics of segmented objects when the 
segmented objects are found. 

12. The method according to claim 11, further 
comprising the step of executing an identical 
correction process for a plurality of segmented objects 
that form the single image on the basis of the 
correction characteristic. 

13. The method according to claim 10, wherein the 
segmented objects are searched for on the basis of a 
rendering position of the object indicated by the 
rendering command. 



14. The method according to claim 13, wherein 
identification information indicating the presence of 
candidates of the segmented objects is recorded in a 
memory in correspondence with a rendering region of the 
object and neighboring regions thereof . 

15. The method according to claim 14, wherein it is 
determined that the segmented object is present when 
the identification information which neighbors or 
overlaps the rendering region of the object indicated 
by the rendering command to be processed is present. 

16. The method according to claim 14, wherein whether 
to record the identification information or not is 
selected on the basis of a height or width of the 
segmented object and the number of objects within a 
page. 

17. The method according to claim 11, wherein the 
correction characteristic is decided on the basis of a 
color or luminance distribution of the object which is 
determined to undergo the correction process. 

18. The method according to claim 17, wherein the 
correction characteristic of a plurality of segmented 
objects that form the single image is decided by 
combining pieces of the color or luminance distribution 
information extracted from those segmented objects. 

19. A computer program product comprising a computer 
readable medium having a computer program code, for an 



image processing method, comprising process procedure 
codes for: 

inputting a rendering command; 

discriminating a type of object to be rendered on 
the basis of the rendering command; 

judging based on the discrimination result if the 
object is to undergo a correction process; and 

searching for segmented objects obtained by 
breaking up a single image together with the object 
which is determined to undergo the correction process. 
20. The product according to claim 19, further 
comprising a process procedure code for deciding a 
correction characteristic of the correction process on 
the basis of characteristics of segmented objects when 
the segmented objects are found. 



ABSTRACT OF THE DISCLOSURE 
When rendering commands of objects obtained by 
segmenting a source image are issued, since these 
segmented objects cannot undergo an identical 
5 correction process based on the color distribution of 
the source image, an image with poor image quality is 
often obtained in place of an image with high image 
quality. Hence, the type of object to be rendered is 
discriminated (840), it is checked if the object of 

10 interest is to undergo the correction process (S50, 
S70) , and segmented objects obtained by segmenting a 
single image together with the object which is 
determined to undergo the correction process are 
searched for (S90) . If the segmented objects are found, 

15 the correction characteristics of the correction 
process are determined on the basis of the 
characteristics of these segmented objects (S140) . 
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